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We investigate the stability of negative image equilibria in mean synaptic weight dynamics gov- 
erned by spike-timing dependent plasticity (STDP). The neural architecture of the model is based 
on the electrosensory lateral line lobe (ELL) of mormyrid electric fish, which forms a negative image 
of the reafferent signal from the fish's own electric discharge to optimize detection of external electric 
fields. We derive a necessary and sufficient condition for stability, for arbitrary postsynaptic poten- 
tial functions and arbitrary learning rules. We then apply the general result to several examples of 
biological interest. 
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I. INTRODUCTION 



Synaptic plasticity is thought to be a fundamental 
mechanism for learning and adaptation in biological neu- 
ral networks The activity dependence of synaptic 
plasticity has been observed experimentally 0, y|, but 
the precise nature of that dependence, and its func- 
tional or computational consequences, are still largely 
unknown. The purpose of the present article is to de- 
rive clear functional consequences from specific forms of 
activity-dependent synaptic plasticity. 

Current models of synaptic plasticity are of two main 
types: rate-based, and timing-based. In rate-based mod- 
els, changes in synaptic weight depend on the mean spike 
rate of presynaptic and postsynaptic cells, usually via 
correlations |4, 5]. Since mean spike rates are averages 
over time windows containing many spikes, the timing 
of individual spikes is unimportant in rate-based models. 
Recent experimental studies 0, S have shown that in 
some systems the precise timing of individual spikes can 
have a pronounced effect on synaptic plasticity. Mod- 
els of such spike-timing dependent plasticity (STDP) '9| 
calculate changes in synaptic weights by combining the 
effect of all pairs of presynaptic and postsynaptic spikes 
[lOtllll nil Hill where the effect of each pair is a func- 
tion of the time between them (called the spike-timing 
dependent learning rule). 

One system in which STDP has been observed exper- 
imentally, and where its functional role is understood, 
is the electrosensory lateral line lobe (ELL) of mormyrid 
electric fish 7J. The mormyrid identifies objects in its en- 
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vironmcnt by emitting a stereotyped electrical discharge 
and detecting the perturbations to the resulting electrical 
field at the skin surface due to external objects. To cancel 
the predictable sensory input due to its own discharge, 
the mormyrid sends a series of time-delayed, time-locked 
inputs to the ELL, synchronized to the fish's electrical 
discharge |l5j . The neurons receiving these inputs have 
plastic synapses onto neurons receiving primary affer- 
ent input. The repeated time-locked inputs, paired with 
the reafferent input, act via a spike-timing dependent 
learning rule to change synaptic weights, in such a way 
that the summed postsynaptic potential due to the time- 
locked inputs forms a negative image of the potential 
due to the fish's own discharge 116|. This effectively nulls 
out the sensory effect of the fish's own discharge, thus 
improving detectability of perturbations due to external 
objects. 

To be behaviorally useful to the fish, the set of synaptic 
weights which create the negative image must be a sta- 
ble equilibrium for the weight dynamics induced by the 
spike-timing dependent learning rule. Conditions for ex- 
istence and stability of such equilibria were first explored 
in Xt]; the present paper is an extension and refinement 
of that work. The principal extension is the derivation of 
an analytic criterion for stability of negative image equi- 
libria for arbitrary postsynaptic potential functions and 
arbitrary spike-timing dependent learning rules. 



II. FRAMEWORK 

The model consists of a single postsynaptic cell driven 
by an array of time- locked presynaptic cells, a repeated 
external input, and other unspecified inputs collectively 
modeled as a single noisy external input 18, 19, 20] (Fig. 

This architecture is based on the mormyrid ELL, 
but is general enough to capture the dynamics of other 
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FIG. 1: Schematic of the architecture. The postsynaptic cell 
receives inputs from A*' presynaptic neurons, a repeated ex- 
ternal input (/"(a;), and unspecified noisy inputs. Presynaptic 
neuron i spikes at time Xi in each period of (j), and has synap- 
tic weight Wi onto the postsynaptic cell. 



neural systems hypothesized to have an array of time- 
delayed, time- locked inputs pll[2^. The framework for 
the neural dynamics is the spike response model |23j |. 
without refractoriness. 

Each presynaptic cell i spikes exactly once at a fixed 
time within each sweep of the repeated external input, 
causing a corresponding postsynaptic potential response 
(PSP) in the postsynaptic cell. 

The total membrane potential in the postsynaptic cell 
is the sum of these PSPs, weighted by synaptic efficacies 
(weights) Wi, and the two external inputs. This mem- 
brane potential induces the postsynaptic cell to spike at a 
certain (noisy) rate. Each presynaptic spike causes a con- 
stant (nonassociative) change in the weight Wi, and each 
postsynaptic and presynaptic spike pair causes a change 
in Wi according to a spike-timing dependent learning rule, 
namely a function of the time difference between the 
postsynaptic and presynaptic spikes (associative learn- 
ing). 

The repeated external input is modeled as a peri- 
odic input with period T. We use two time variables: 
X £ [0, T) for the time within each repetition of the ex- 
ternal input, and t = nT, n G Z for the time of initiation 
of each such period General dynamical quan- 

tities will be functions of the pair {x,t). Let Xi be the 
time within each period when presynaptic cell i spikes, 
and Wi{x,t) its corresponding weight. Since presynap- 
tic spikes are time-locked to the external input, Xi is 
independent of t. Let £{s) be the PSP evoked by neu- 
ron i at time s after a spike. We assume £ is causal: 
£{s) — for s < 0. Let a be the nonassociative weight 
change due to a presynaptic spike, and C{s) the asso- 
ciative weight change due to a postsynaptic spike time s 



after a presynaptic spike. Let 4'{x) be the periodic ex- 
ternal input, and U {x, t) the total postsynaptic potential 
due to the non-noisy inputs. We assume that for each t, 
the mean instantaneous postsynaptic spike rate density 
(in x) is given by f(U{x, t)) for some positive and strictly 
increasing function /. The function / can be thought of 
as the effective gain of the postsynaptic cell in the pres- 
ence of the noisy inputs. High or low noise correspond 
to an / with small or large maximum slope respectively. 
No attempt is made to include a refractory period for 
postsynaptic spikes; and we will assume the period of (j) 
is greater than the refractory period of the presynaptic 
neurons, so that refractoriness on the presynaptic side is 
irrelevant. 

Changes in weights will be implemented as discrete 
steps with no internal time course. In the present model 
there are two natural choices for the time at which weight 
changes occur: asynchronously (instantaneously, when- 
ever a presynaptic or postsynaptic spike occurs) , or syn- 
chronously (once per sweep of the repeated external in- 
put, updating all weights simultaneously). We adopt 
the latter strategy, updating weights at a; = for each 
t = nT, n G Z. The value of Wi in the period beginning 
at (0,i) is then independent of x, and will be denoted 
Wi{t). For synchronous updating to be a reasonable ap- 
proximation, we must assume that weight changes per 
cycle are small relative to the weights themselves (slow 
learning rate). Changes in weights due to different spikes 
or spike pairs are assumed to add linearly. 

In biological systems, synaptic weights have bounded 
magnitude and do not change sign. Since the present 
paper is focused solely on the dynamics near equilibria, 
we impose no boundary conditions in the model. The re- 
sults still apply to the biological case provided the weight 
equilibria are in the region enclosed by biological bounds. 

We assume homogeneous parameters: the scalar a and 
the functions £, C are the same for all presynaptic neu- 
rons, and the times Xi are regularly spaced, Xi = iS, 
i = 0, 1, . . . , TV - 1 for some ^ > 0, iV = T/^ > 1. 

For simplicity in the derivation of the weight dynamics, 
it will be convenient to assume that £{s),C{s) are zero or 
negligible for \s\ > te,tl respectively, with te,tl ^ T. 
We will also require the learning rate to be slow: T <^ t^, 
where r^, is the time-scale on which weights undergo sig- 
nificant relative change. For the existence of approximate 
negative image states we will need the spacing of presy- 
naptic spike times much smaller than the widths of £ 
and C: S <^ te,tl. These time-scale assumptions can be 
summarized as 



<5< {te,tl) <r<T^. 

Typical values for the mormyrid ELL are: S < 1ms [T5| . 
[C.C. Bell, private communication], te ^ 20ms 0, tl ~ 
40ms 0, T ~ 80ms [C.C. Bell, private communication], 

lo^r 0. 



3 



post 















i 


pre 


1 








/3<3St 







t + T 



(a) 




t +T 



(b) 



FIG. 2: Changes in weight due to pairing of presynaptic and 
postsynaptic spikes, (a) Pairing of a postsynaptic spike at 
time {x,t) and presynaptic spike by neuron i at time {xi,t) 
causes a change jC{x — Xi) in weight Wi. (b) For x within tl 
of a period edge, we must include pairing with presynaptic 
spikes in the neighboring period. Pairing of a postsynaptic 
spike at time [x, t) and presynaptic spike by neuron i at time 
{xi,t + T) cause a change C{x ~ Xi ~ T) in weight Wi. 
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FIG. 3: Postsynaptic potential due to presynaptic spikes, (a) 
Potential at time (a;, t) due to presynaptic spike by neuron i 
at time {xi,t) is 'Wi(t)£(x — Xi). (b) For x within te of 0, 
we must include the potential due to presynaptic spikes in 
the preceding period. The potential at time {x,t) due to the 
presynaptic spike by neuron i at time (xi,t — T) is unit — 
T)£ix-x, + T). 



III. WEIGHT DYNAMICS 

To obtain the mean weight dynamics, we compute the 
mean value of Wi{t + T) — Wi{t). The nonassociative 
change in Wi{t) due to the single presynaptic spike at 
{xi,t) is a. For the associative change due to presynap- 
tic and postsynaptic spike pairs, consider the effect of 
a single postsynaptic spike at {x,t). The pairing of this 
spike with the presynaptic spike at {xi,t) causes a change 
£{x — Xi) in Wi. To properly handle edge effects, we also 
include the pairing with presynaptic spikes at {xi ,t — T) 
and {xi,t + T), for a total change of 



£(2;- 



T) + C{x-x,) + C{x-x, + T). (1) 



For typical biological applications, where <C T, at 
most one of the above terms is non- negligible, but all 
must be included to handle cases where within 
TL of T or -T (Fig. In addition, tl -^T allows us 
to approximate Eq. by 



■C{x 



nT) — C{x — Xi), 



(2) 



where £(s) — X^^oo ^ "'-^) pcriodization of C 

with period T. 

Quantity Q is the change in Wi{t) due to a single 
postsynaptic spike at {x,t). Postsynaptic spikes between 
t and t + T occur at a mean rate density f{U{x, t)); hence 
the mean total change due to all postsynaptic spikes be- 
tween t and < + T is 



dx f{U{x, t))C{x — Xi). 



The mean total change in Wi{t) due to both nonassocia- 
tive and associative learning is therefore 



(Am,(i))=a+/ dxf{U{x,t))C{x-x,). (3) 

We now compute the postsynaptic potential U (x, t). The 
contribution to U{x,t) due to the presynaptic spike by 
neuron i at {xi,t — nT) is Wiit -\- nT)£{x — Xi + nT). 
For Te T this quantity is non-negligible for at most 
one value of n, either n = (current period) or n = — 1 
(previous period). But to properly handle edge effects 
(Fig. El) we include both, for a total contribution of 

Wi{t — T)E{x — Xi — T) + Wi{t)£{x — Xi). (4) 

We assume that the learning rate is sufficiently slow that 
we may approximate quantity I0J by 



Wt{t){£{x - Xi -T) + £{x - Xi)). 



(5) 



Finally, te <Si T allows us to approximate quantity © 
by 

Wi(i) 2j^(a^ - nT) = Wi{t)S{x - Xi), (6) 



where £{s) = '^"^^o^i^ ~ '^'^) pcriodization of E 

with period T . 

Quantity ^ is the contribution to U (x, t) from neuron 
i. The total postsynaptic potential is the summed con- 
tribution from all presynaptic neurons, plus the repeated 
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FIG. 4: An approximate negative image. If the postsynaptic 
potential U{x,t) — (j}(x) + '^^^iWj{t)£{x — xj) is approxi- 
mately some constant Uo, then the potential X^jLi 
Xj) due to presynaptic spikes alone is approximately Uo — (l>{x). 



external input: 



N 



U{x, t) = + ^ {t)£{x - 



(7) 



Equations Eq. Q and Eq. ^ define the mean weight 

o 

dynamics. The common periodicity of the functions f , 

o 

C and (j) is an important feature, allowing the systematic 
use of Fourier techniques. 

IV. THE NEGATIVE IMAGE 

A set of weights {wi] for which the total postsynaptic 
potential U{x,t) is approximately constant in x will be 
referred to as an approximate negative image state. For 
such a state the contribution to the postsynaptic poten- 
tial due to the presynaptic cells alone is, up to an additive 
constant C/q, an approximate negative image (Fig. Q of 
the external input (f>: 



N 

E 



Wj£{x — Xj) ~ [/q — 4>{x). 



(8) 



In the following, we first show that approximate nega- 
tive image states exist provided a certain condition holds 
on the Fourier coefficients of the postsynaptic potential 

o 

function £ and the repeated external input 0, and pro- 
vided the presynaptic spike time-spacing 5 is sufficiently 
small. We then show that for a particular value of Uq 

o 

(depending on a, £, and /) there exists an approximate 
negative image state which is also an equilibrium (fixed 
point) for the weight dynamics. 



For generic £ and 0, Eq. ((Sj) cannot be made an exact 
equality for all x, because that would require solving in- 
finitely many independent linear equations (one for each 
x) in only finitely many unknowns (the N weights {wj}). 
But if we replace the discrete set of weights Wj by a con- 
tinuum weight density W, then the analog of Eq. © 
can, under certain conditions, be made exact for all x. 
Given such a density, we then recover the biological case 
of discrete weights {wj} for which Eq. (jSJl is approx- 
imately true by defining the set {w-,} to be a discrete 
approximation to W. 

Let W{y) be a weight density, with W{y)dy being the 
total weight for presynaptic spikes occurring between y 
and y + dy, for y G [0, T). The continuum analog of Eq. 
©, with exact equality for all x, is 



dyW{y)£{x - y) ^ Uo - ^x). 



(9) 



To solve this equation for W we take the Fourier de- 
composition. Let Wn = (l/T) dye'''"yW{y) for /c„ = 
27Tn/T, n G Z he the Fourier coefficients for W, and let 

o 

En, (t>n be the coefficients for £ and (/). Then Eq. 
becomes 



-iknX 



Uo - E 

n— — oo 

/ dy{ V Wne-'^-y)i V Erne-'^-^'^-y^) 



n— — oo 
oo oo 



7n— — oo 



n— — oo m— — oo 



T J2 ^nEn 



11— — oo 



Hence W satisfies Eq. ^ if and only if 



Wo = 



TEq 



TEn' 



(10) 



Given such a W, we construct approximate negative im- 
age states with discrete weights as follows. Define g(x) 
to be the deviation from a negative image: 



N 



g{x) = (t){x) - Uq - ^ Wj£(a; - Xj). 



(11) 



Then {wj} is an approximate negative image state if g{x) 
is small relative to Uq — <j>{x), for all x. Consider the set 
of weights defined by 

w, =SWixj), 

where d is the spacing of the xj. These weights can be 
thought of as a discrete approximation to the weight den- 
sity W{y). Substituting into Eq. (fTTT) and using Eq. @ 



5 



gives 



N 



g{x) = 



dyW{y)£{x-y). 



This is the difference between a Riemann sum and the 
integral it approximates. The error theorem for Riemann 
sums then gives an upper bound for g: 



',ix)\<S^ma.^\^[W{y)kx 
2 y ay 



(12) 



Hence, for \g{x)\ to be smah, we need 'W{y)£[x — y) to 
be differentiable in y, hence Wiy ) to be difFerentiable in 
y. A theorem of Fourier series ^3 says that W{y) is 
differentiable if E,T=-ool"W^"l < oo- % Eq. ^ this 

o 

places a constraint on the Fourier coefficients of £ and 4>: 



OO 

E \ E 

i—~-oo 



< OO. 



(13) 



This inequality requires (/)„ to go to zero as n — * ±oo 
more rapidly than En/n^. In particular, the high fre- 
quency (large \n\) spectral content of (p must be less than 

o 

the high frequency content of £. Intuitively, in order for 

o 

the convolution of £ with a smooth weight density W 
to be able to "match" the high frequency components of 
— (/>, the high frequency content of (p cannot be too large. 

If Eq. H13|l is satisfied, and S is sufficiently small, then 
from Eq. H12|l the deviation g(x) from an exact negative 
image is small, hence approximate negative image states 
exist. 

We now show that for a particular Uq there exists an 
approximate negative image state that is an equilibrium 
for the weight dynamics. From Eq. ||2J), a weight state 

{wj} is an equilibrium if U{x) — 0(a;)+X]^i 
satisfies 



a+ dxf{U{x))C{x-Xi) = for alH. (14) 

This is a system of N equations in the N unknowns {wj}, 
but they are nonlinear equations for nonlinear /. In gen- 
eral such equations need not have solutions, but for ap- 
proximate negative image states the nonlinearity is in 
some sense "small" , and this will allow us to show that 
solutions exist provided 5 is sufficiently small. 

For an approximate negative image state we have 
U{x) = Uo -\- g{x) with g{x) <C Uq, and we wish this 
U{x) to satisfy Eq. First define Uq so that Eq. 

(|14|l would be satisfied if g{x) were identically zero: 



a+ dx fiUo)C{x - a;,) = for all i. (15) 
Jo 



This requires 

fiUo) 



dx C{x — Xi) 



for all I 



rp O ' 

/o dx£{x) 



(16) 



where the independence of i follows from the periodicity 

o 

of C. Hence our desired Uq exists and is given by 



rp O 

/o dx£{x) 



(17) 



provided a, C and / satisfy 
min f{u) < 



-a 



rp O 

la dxC{x) 



< TCL&yi f {u) . (18) 



From Eq. (^Sl, U{x) = f/o + g{x) satisfies Eq. if 
and only if 

dx [f{Uo + g{x)) - f{Uo)]L{x - Xi) = Q for all i. 

(19) 

For brevity let h{x) = f{Uo + g{x)) — /(C/q) and Li{x) — 

o 

L Then Eq. H19(l can be written as 

{h,L,)=0 foraUi, (20) 
where (•, •) is the inner product defined by 



(/l,/2 



dx fi{x)f2{x), 



(21) 



for /i, /2 in the space X of smooth functions on the 
interval [0,T]. 

Let H be the set of functions h corresponding to all 
possible values of the weights {wj}: 

H = {h: h{x) = /(0(x) -Y,w°£{x - Xj)) - f{Uo), 

WjeR,j^l,...,N}, 

N ° 

where we have used Uo + g{x) = 0(a;) — Wj£{x — Xj) 

from Eq. (|ll|l . Let S be the subspace of X consisting 
of all linear combinations of the {Li}, and be the 
(infinite dimensional) subspace of X orthogonal to S (in 
the inner product defined by Eq. H21|) '). Then there exists 
an h satisfying Eq. (|20|l if and only if H and have 
nonempty intersection: 



(22) 



We claim that condition (|22|) holds if 6 is sufficiently 
small. If S is small, then the bound H12|) implies that g{x) 
is small for all x. In that case h{x) = f{Uo+g{x)) — f{Uo) 



6 



is approximately its linearization in g, which we denote 
by ho{x): 

h{x)~h^{x) = nUo)9{x) 

N 

= f{Uo){(P{x)~Uo + J2^jhx-Xj))- 
J=l 

Let Hq be the set of such Hq corresponding to all possible 
values of the weights {wj}: 

N 

o 

Ho = {ha : ho{x) = /'([/o)((/)(x) - Uq + Wjf (a; - Xj)), 

w,eR,j^l,...,N}, 

Then the condition that Hq have nonempty intersection 
with S-^, 

HonS^^ 0, (23) 

is equivalent to existence of ho £ Hq such that {ho, Li) = 
for all i. This is equivalent to the linearization of the 
system (fT^ : 

T ^ o o 

/ dxf'{Uo){Hx) -Uo+Y] wj£{x - Xj))C{x - X,) = 

for all z, 

which can be rewritten as 

N 

Q^i^i = 7, (24) 
where 7 — ^'^ dx f {Uo){<p{x) — Uo) and 

Q^3 = f'iUo) I dx°E{x - xj)£{x - X,). (25) 
Jo 

This is a system of N linear inhomogeneous equations 
in the N unknowns {wj}, which has a solution provided 
the coefficient matrix Q is invertible. The eigenvalues 
of Q will be calculated in the following section, and for 
generic £ and C all eigenvalues are nonzero. Hence Q is 
generically invertible, so that condition (|23|l holds. Fur- 
thermore, the intersection of Ho with is generically 
transversal (not tangent). 

Now as (5 ^ 0, -ff — > Hq (in the metric induced by 
the inner product 121|l '). By the openness of transver- 
sal intersection (infinite dimensional version, p^l. any 
sufficiently small perturbation of Hq also intersects S^. 
Hence for S sufficiently small, H intersects S-^ (Fig. 01, 
hence h satisfying Eq. H2()|l exists. The corresponding 
weight state {wj} is an approximate negative image equi- 
librium. 




FIG. 5: Transversal intersection theorem. If Ho has transver- 
sal intersection with and H is sufficiently close to Ho , then 
H intersects S^. 



V. STABILITY CRITERION 

We now derive a necessary and sufficient condition for 
the mean stability of approximate negative image equilib- 
ria, by examining the linearized weight dynamics around 
such states. Let {wj} be an approximate negative image 
equilibrium satisfying Eq. Hll|l with 

N ^ 

U{x) = (j>{x) + Y WjSix - Xj) = Uo + g{x) (26) 

Solving for <j){x) in Eq. H26|l and substituting into (0 
yields 

N 

o 

U{x,t) = [/o + .g(.T) + 2_]i;j(i)£:(a;-Xj), 

where vj (t) = Wj (t) — Wj is the deviation of weight j from 
its equilibrium value, and g{x) is the deviation from a 
negative image in the equilibrium state {wj}. To first 
order in Vj we then have 

N 

f{U{x,t)) f{Uo+g{x))+f{Uo+g{x))J2vjit)h^-Xj)- 

j=i 

(27) 

Substituting Eq. l|77|l into Eq. and using Awj(<) = 
Avi{t) yields 

{Av,{t))=a+ dxf{Uo + g{x))C{x-x,) 
Jo 

^ o o 

+f'{Uo + g{x)) Y ^At)hx - x,))C{x - Xi). 

From the equilibrium condition Eq. (|14|) and Eq. I|26|) . 
the term in Eq. H28I) of zeroth order in Vj vanishes. Hence 

N 

(Ai;,(t)) ^^Py«,(t), 
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where 



Pi. 



dx f'{Uo + g{x))E{x — Xj))C{x — Xi). 



Now assume 5 is sufficiently small that 

Then /'(C/o + 5(2;)) ~ /'([/q) for all x, so that ~ Qy , 
where Q is the matrix defined in Eq. (|25|l . and we obtain 



AT 

Taking the mean on both sides and using {Avi{t)) — 
A{v,{t)) yields 



AT 



(28) 



Eq. (|28|) gives the linearized dynamics for {vi{t)) near 
{vi{t)) = 0, hence for {wi{t)) near the approximate neg- 
ative image equilibrium {wj}. 

The system Eq. (|28|) is stable if and only if all eigen- 
values oi Q + 1 have norm less than 1 . Due to periodicity 

o o 

of £, £ and regular spacing of the {xi}, the matrix Q has 
the property that each of its rows equals the row above it 
shifted one entry to the right (and wrapped around at the 
edges). Such matrices are called circulant |23| and their 
eigenvectors and eigenvalues are easily found, as follows. 
Let u be the vector with components Ui — e*'^^' ; then 



N 



N 

= E 



dxE(x — Xj)L(x — Xi), 



so that 



{Qu) 



N 



Ve^'^'^^^-"^*) / dxE{x-Xj)C{x^x,). (29) 



By periodicity of £ and £, the integral in the above ex- 



pression is a function of Xj 



modulo T. The factor 



ik{xj - 
ikT 



is also a function of Xj ~ Xi modulo T provided 
gifcT _ 2. Now if the {xi} are regularly spaced, the sum 
over j of a function of Xj — Xi modulo T is independent of 
i. In that case Eq. (^5)1 would imply {Qu)i/ui indepen- 
dent of i, hence u is an eigenvector of Q, with eigenvalue 
the right hand side of Eq. . We get a complete set 
of such eigenvectors by taking N values of k such that 



gifcT _ Y and the functions e^^^^ are independent func- 
tions of i. Here we choose 
27rn 

kn = —, n = 0,l,...,iV- 1. 
The corresponding eigevalues of Q are 

A„ = Ve''^"^^^-^-) / dx£{x-xj)£{x-x^). 

Letting Zj = Xj — Xi, making the change of variables 

o o 

y — Xj — X and using periodicity of £ gives 

N /-Too 

A„ = ^e^fc"-. / dyk-y)h^,~y) 

N o Z 

= ^e**^"^^£*T^(a:j), 
where *t is convolution on the interval [0,T], ~ is hori- 

o o 

zontal reflection (£(y) = £{~y)), and since {zj} — {xj} 
we have replaced Zj by Xj in the sum. 

The stability condition is |1 -f A„| < 1 for all n: 



Stability: 



N 



(30) 



i=i 
27rn 

kn - — , n = 0,l,...,iV-l. 
In the biological setting two limiting regimes are of spe- 

o 

cial interest: slow learning (£ small) and dense spacing 
{S small). 

o 

If £ is small, then so are the eigenvalues of Q. If A„ = 
o-n + with a„, bn real, we have 

|1 + A„|2 = (1 + a„)2 -bl = l + 2a„ + {al - hi). 
If a„ and 6„ are sufficiently small, this quantity is less 

o 

than 1 if and only if a„ < 0. Hence for C sufficiently 
small, all eigenvalues of Q -I- / have norm less than 1 if 
and only if all eigenvalues of Q have negative real part^. 
The stability condition then becomes Re A„ < for all 
n. Hence in the slow learning limit Eq. (|30|l becomes 



Slow learning: 



N 



Re^e^^'''''C*T£{xj) <Q, n = 0, 1, TV - 1. (31) 



^ The slow learning limit can thus be thought of as the continuous 
time (continuous t) limit. All eigenvalues of Q having negative 
real part is equivalent to stability of the system d{v)/dt = Q(v) 
and hence of Td{v)/dt = Q(v), which is the continuous time 
version of Eq. I28i . 
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The dense spacing limit {S — > 0) is the continuum limit 
in Xi- The discrete weight density Wi/T is replaced by 
a continuum weight density W{x), sums over Xj are re- 
placed by integrals over x, and N oo. This yields 

Xn = f dxe'^-'-'C*Tl{x) n = 0,l,... 

^0 

o o 

Hence A„ is just the n*'* Fourier coefhcient of £*t£- The 
Fourier convolution theorem then gives 

o o o o 

Xn — LjiEn — LjiEji^ 

o o o 

where En,En,Ln are the n*'* Fourier coefficients of 

o o o 

E, E, L respectively, and z is the complex conjugate of 
z. Substituting into the stability condition |1 + A„| < 1 
for all n gives the dense spacing limit of Eq. (|30|l : 

Dense spacing: 
|1 + I„£;„|<1, n = 0,l,- (32) 

Finally, with both slow learning and dense spacing the 
stability condition becomes 

Slow learning, dense spacing: 

Re[LnEn] <0,n = 0,1,... (33) 

A further simplification follows in the long period limit, 
te^tl <C T. Holding te, tl constant and taking T — > oo, 

o o 

the Fourier series of £,£ in Eq. (|33|l approach Fourier 
transforms of 5, £. The stability condition then becomes 

Slow learning, dense spacing, long period: 
Re[T [C] {k)T[£]{k)] < 0, fee (-oo, oo). (34) 

For the calculation of examples we will work in the slow 
learning, dense spacing, long period limit, which is the 
limit of primary biological interest in the mormyrid ELL. 

VI. GENERAL REMARKS 

The Roles of Nonassociative and Associative 
Learning. Both nonassociative and associative learn- 
ing {a and C, respectively) play a role in whether approx- 
imate negative image equilibria exist, via Eq. (|18|l . They 
are also both involved in determining the location of such 
equilibria, via Eq. 114|) . The interpretation of Eq. I|14() is 
that at equilibrium, the mean change due to nonassocia- 
tive learning (a) must be precisely opposite to the mean 
change due to associative learning (the C term). If the 
postsynaptic spike rate density / is bounded, this places 
a relative magnitude constraint on a and C, namely Eq. 
(|18|l . If this constraint is violated then the mean changes 



due to associative and nonassociative learning are unable 
to balance one another, and no negative image equilib- 
rium is possible. 

By contrast, only associative learning plays a role in 
the stability of approximate negative image equilibria, 
via Eq. (|30() . The irrelevance of nonassociative learn- 
ing for stability has an intuitive interpretation: near 
an approximate negative image equilibrium, the mean 
nonassociative change is cancelled by the mean associa- 
tive change due the constant postsynaptic potential Uq 
around which U{x,t) fluctuates. Only the deviations of 
U{x,t) from Uq cause a net change in the weights, and 
these changes are purely associative (due to postsynaptic 
spikes generated by U{x,t)). Alternatively, nonassocia- 
tive learning can be analogized to a constant externally 
applied force in a physical system. Such a force changes 
the location of equilibria, but has no effect on the dy- 
namics around equilibria. 

The Role of the Repeated Input. For a given 
postsynaptic potential response £, the repeated input 
plays a role in the existence of approximate negative im- 
age states via Eq. (|13ll : cannot have too much high 
frequency content relative to £ for such states to exist. 

Assuming is such that approximate negative image 
states exist, it then plays the important role of deter- 
mining the weight configurations in such states, an in 
particular in approximate negative image equilibria, via 
Eq. (0. 

But (/) plays no role in the stability of the resulting neg- 
ative image equilibrium. This is intuitively reasonable, 
since in approximate negative image states </> is "nulled 
out" by the summed postsynaptic potentials due to time- 
locked presynaptic spikes. 

The Role of Noise. The functional form of the 
mean postsynaptic spike rate / affects the existence and 
location of the negative image equilbrium via Eq. H18|l 
and Eq. ifT^ . 

But provided / is strictly increasing (so that /' is pos- 
itive), / has no effect on the stability of the equilibrium. 
Hence the classification of learning rules as (mean) stable 
or unstable is, except for this mild monotonicity require- 
ment, insensitive to the fine structure of the noise. This 
is a post hoc justification for not modeling the noise in 
more detail. 

Canonically Stable Learning Rule: C = —£. In 

the dense spacing and slow learning limit, suppose C ~ 
—£. The stability condition Eq. is then 

\En\^>0 foraUn, (35) 

o 

or in other words. En ^ for all n. Since this is true for 
generic £, the learning rule L = —£ is generically stable. 
Area Sign Condition. In the dense spacing and 

o 

slow learning limit, consider n = in Eq. (|33|l . Since Lq 

o o o 

and Eq = Eq arc just the areas under the functions C 

o 

and £, Eq. H33|) says that for stability, these areas must 
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fteJF[£]((i!) 



FIG. 6; If Re[J^[£] (k)] changes sign at feo, then for the prod- 
uct y^[C] {k)Re[J^[£] (k)] to be negative around ko we must 
have [jC] (k) also change sign at fco, in the opposite sense to 
Re[J^[£]]{k). 



be opposite in sign. If they are the same sign, then the 
negative image is unstable. In particular, if £ and C are 
both nonnegative, the negative image is unstable. Hence, 
if £ is an excitatory PSP and C is any pure potentiating 
learning rule, the negative image is unstable. Similarly, 
inhibitory PSPs with purely depressing learning rules are 
unstable. 

Symmetric and Antisymmetric Learning Rules. 

In the dense spacing, slow learning, long period limit, 
there is a nonempty, positive measure set of postsynap- 
tic response functions for which purely symmetric or 
purely antisymmetric learning rules are generically un- 
stable. This follows from the fact that the Fourier trans- 
forms of symmetric and antisymmetric functions are pure 
real and pure imaginary, respectively. 

Suppose the real part of the Fourier transform of £ has 
a zero: 

ReiJ" [£] (fco)] = 0, for some fco- (36) 

Then, generically, i?e[J^[f] (fc)] changes sign at fco. Sup- 
pose C is symmetric, so that !F [£] (fc) is pure real. Then 

Re[T [C] {k)T\£]{k)] = T [£] (fc) Re[T [£] (fc)]. 

Since i?e[jr[£] (fc)] changes sign at fco, for the stability 
condition Eq. H34|l to be satisfied for fc near fco, we must 
have [£] (fc) change sign at fco, in the opposite sense to 
Re[T[£] (fc)]; see Fig. But this forces [£] (fco) = 0, 
which is untrue for generic symmetric £. Hence generic 
symmetric learning rules are unstable for postsynaptic 
response functions satisfying Eq. (|^ . 

Similarly, if the imaginary part of the Fourier trans- 
form of £ has a zero: 

Im[J^ [£] (fco)] = 0, for some fco. (37) 

then generic antisymmetric learning rules are unstable. 

Pure antisymmetric learning rules have another diffi- 
culty: since they satisfy dx C{x) — 0, near a negative 
image equilibrium the mean weight change per cycle due 
to an antisymmetric £ is zero, to first order in g. The 



total mean weight change per cycle is therefore approx- 
imately a. Hence negative image equilibria for pure an- 
tisymmetric learning rules are only possible if a = (no 
nonassociative learning). 

Cooperative Stability. It follows from Eq. H3U|) 
that the sum of stable learning rules is stable; but it 
is also clear that given a generic £, there exist pairs of 
learning rules Ci and £2, each individually unstable, for 
which the sum £1 + £2 is stable. This is most easily 
seen by direct computation in the slow learning, dense 
spacing, long period limit, via Eq. H34|) (see the examples 
calculated below). 

Duality Principle. Interchanging £ and £ in Eq. 
(|25|l transforms Qij to Qji, hence Q to , hence Q + 1 
to {Q + 1)^ . The eigenvalues of a matrix are unchanged 
by transposition. The stability condition, that all eigen- 
values of Q + / have norm less than 1, is thus invariant 
under interchange of £ and £ . In other words, a PSP £ 
and learning rule £ are a stable pair if and only if the 
PSP £ and learning rule £ are a stable pair. 

This has potential biological relevance if the functional 
forms of PSPs and associative learning rules overlap. The 
single-lobe exponential and alpha function learning rules 
treated in the examples, below, are also plausible PSPs, 
hence duality applies. 

Inversion Principle. Replacing £ by —£ and £ 
by — £ in Eq. (|25|l leaves Qij invariant, hence Q + I 
invariant. The stability condition is therefore invariant 
under inversion of both £ and £. In other words, a PSP 
£ and learning rule £ are a stable pair if and only if the 
PSP — £ and learning rule — £ are a stable pair. 

In particular, the stable learning rules for an inhibitory 
PSP are just minus the stable learning rules for the 
corresponding excitatory PSP. Plasticity at inhibitory 
synapses was explored in |28l. and preliminary experi- 
mental evidence given in |29l ] . 

Independence of Normalization. In the slow 
learning and dense spacing limit, the stability conditions 
Eq. H33|l or Eq. (|34|l are invariant under multiplica- 
tion of £ or £ by positive constants. Hence, provided the 
magnitudes of £ or £ are not so large that the slow learn- 
ing assumption is violated, stability does not depend on 
those magnitudes. In particular, in working with specific 
examples it is not necessary to give £ or f any overall 
normalization. 



VII. EXAMPLES 

Working in the slow learning, dense spacing, long pe- 
riod limit, we now compute explicit criteria for stabil- 
ity when £ and £ have functional forms commonly used 
in the spike-timing dependent plasticity literature. The 
PSP £ will be assumed excitatory and causal, and of ex- 
ponential or alpha function form. The learning rule £ will 
consist of one or two "lobes": a "pre-before-post" lobe 
(presynaptic spike before postsynaptic spike) and/or a 
"post-before-pre" lobe (postsynaptic spike before presy- 
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(a) 



crj = +1 


0-1 = +1 




CT2 = -1 










X 


(7J = -1 -■ 






<T2 = — 1 


cr2 = +1 





(b) 



^>0 



>1< 



CTl = +1 




(c) 



FIG. 7: PSPs and learning rules used in the examples, (a) The 
PSP f '^'^'(x) is exponential for pe = and an alpha func- 
tion for Pe = 1- (b) One- lobe learning rules of alpha func- 
tion form, C\^\x), for the four possible combinations of ai 
(potentiating or depressing) and a2 (pre-before-post or post- 
before-pre). (c) Two- lobe learning rules of alpha function 
form, c\^j{x), for the four possible combinations of ai (pre- 
before-post lobe potentiating or depressing) and the sign of 
A (post-before-pre lobe potentiating or depressing). The area 
of the pre-before-post lobe is normalized to ±1, and the area 
of the post-before-pre lobe is A. 



naptic spike). Each lobe will be of exponential or alpha 
function form, and either potentiating (positive) or de- 
pressing (negative). Such £ and C can be written as 



follows: 

£(P^)(a;) 



H{x) 



CY'->{x) = ai (a2x)P^e-'^2=^/^^F((T2a;) (one-lobe) 



CTl 



A 




+ ^I+T i-^f'' e^'^^'^^Hi-x) (two-lobe) 
where H is the Heaviside function 
H{x). 

The parameters (see Fig. (TJ are as follows: Pe,Pl = 
for an exponential or 1 for an alpha function; te, tl, 
and tl^ are positive time constants; cti — +1 for 
a potentiating lobe or —1 for a depressing lobe; a2 = 
-1-1 for a pre-before-post lobe or —1 for a post-before-pre 
lobe; and for the two-lobe £, A is the area of the post- 
before-pre lobe, with the area of the pre-before-post lobe 
normalized to ±1 . We impose no overall normalization 
on £ or £, since this has no effect on stability. 

We assume an excitatory PSP E\ to obtain the stable 
cases for the inhibitory PSP — simply replace L by —C 
in the stable cases for E (i.e. replace a\ by —a\ and A 
by ~A). 

For both the one- lobe and two-lobe £, there are four 
possible combinations oipE andp^: exponential or alpha 
function PSP with exponential or alpha function learning 
rule. We will refer to these four cases as ee, ea, ae, and 
aa, with the first letter in the pair indicating that the 
PSP is exponential or alpha function, and the second 
letter referring to the learning rule. 

The Fourier transforms of these E and H, are rational 
functions in fc, and the stability condition will reduce to 
the requirement that a certain polynomial in fc^, whose 
coefficients are themselves polynomials in the parameters 
of E and £, be negative for all fc. Since the algebra in 
all cases is essentially the same, differing only in the size 
and coefficients of the resulting polynomial, we present 
only one case (aa, one-lobe) in full detail and for all other 
cases simply list the end results. 



A. Alpha Function PSP, One-Lobe Alpha Function 
Learning Rule 



For 



we have 



E(x) 



H{x) 



C{x) = CriCT2Xe"'"^^/^^iJ(CT2x) 



^[^](^) = (1^ 

T[C]{k) = 



(1 - a2ikTLY 
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FIG. 8: Range of stable one-lobe C, for given f , in case aa. 
The learning rule must be depressive and pre-before-post, 
with 3 — 2\/2 < tl/te < 3 + 2\/2. Stable examples are 
drawn with solid lines; endpoints of the stable interval are 
drawn with dashed lines. 



leading to 

= C Re[ai{l + ia2kTLf{l~ikTEf] 

= CaiialTlT^k* + {4a2TLTE ~ u^tI - tI)^ + 1] 

where C = TlTl/[{l+a^Tlk^f{l+Tlk^f]. Since C> 0, 
the stability condition is then 

ailalr^k* + (4(727- - air^ - l)k^ + 1] < 

for all k (38) 

where r — tl/te- The expression on the left is a 
quadratic in k^. The condition is impossible for ai = +1 
(it fails at fc = 0) but for ai = —1 more work is required. 
The quadratic ax'^ + 6a; + c is negative for all a; > if and 
only if a < and (6 < or 6^ — 4ac < 0). Applying this 
condition to Eq. (|38|l with cti = — 1 yields 

- 4(T2r- + 1 < (39) 
or {r-(j2)'^{r^ -6a2r + l) < (40) 

For a2 = —I these give —2 — \/3 < r < —2 + V3 or 
—3 — 2\/2 < r < —3 + 2\/2, both of which are impossible 
because r > 0. For a2 — +1 we get 2 — < r < 2 + -\/3 
or 3 — 2-\/2 < r < 3 + 2-\/2; the former is contained in the 
latter, giving stability if and only if 

CTi = —1, (72 = +1, 

3-2\/2 < — < 3 + 2%/2. (41) 

TE 

The only stable case is depressive and pre-before-post, 
with tl/te constrained to lie in a finite interval (Fig. 
IHl). Note that this interval contains tl/te = 1, where 
C = —£ (the canonically stable learning rule). 



Duality is also applicable here. Interchanging £ and C 
in this example is equivalent to interchanging te and tl 
and multiplying both £ and £ by — 1 . The multiplications 
offset and we are left with r replaced by 1/r. It follows 
that if the interval of stability for the pair {£,£) is si < 
r < S2, the corresponding interval for the pair {C,£) 
is si < 1/r < S2- But by duality these intervals must 
coincide; hence we must have si = l/s2. This is indeed 
the case for si — 3 — 2\/2 and S2 = 3 + 2\/2. 

The instability of the (7i = +1 case for any te and te, 
by the failure of the stability condition at A: = 0, is just 
the Area Sign Condition. 



B. Summary of Results 



For the one-lobe learning rules the stable parameter 
ranges are all easily calculated: 



ee: 


(71 = 


-1, 0-2 = - 


fl: 


all tl /te 


ea: 


(71 = 


-1,0-2 = - 


fl: 


tl/te < 2 


ae: 


0-1 = 


-1,0-2 = - 


fl: 


tl/te > 1/2 


aa: 


(71 = 


-1,0-2 = 


+ 1: 


2-V3< tl/te <2 + V3. 



Note that in all four cases we get instability, for all tl 
and te, if £ is not depressive and pre-before-post. For C 
depressive and pre-before-post, all four cases have some 
range of tl/te in which C is stable. The extent of that 
range depends critically on the precise functional form 
of £ and £; but for 1/2 < tl/te < 2 we have stability 
independent of the functional form of £ and C. 

For the two-lobe learning rules the polynomial arising 
out of the stability condition has coefficients depending 
on (7i and on three continuous parameters: ri, r2 and A, 
where ri ~ tl^/te-, 7*2 = tl^/te- The polynomials are 
given in the Appendix. 

In all four cases, cti = +1 is always unstable. For 
(7i = —1, the boundaries of the stable region in (ri,r2) 
for various values of A are plotted numerically in Fig. |51 

For one-lobe learning rules we found that only depres- 
sive and pre-before-post permits stability. For two-lobe 
learning rules, the pre-before-post lobe must be depres- 
sive for stability, and the post-before-pre lobe cannot 
have area A greater than 1. This is just the Area Sign 
Condition: the area of the pre-before-post lobe is -1, and 
for stability when paired with an excitatory PSP £ the 
total area under the learning rule C must be negative. 

For A < 1, the effect of the post-before-pre lobe shows 
the following general trends: in cases ee and ae, as the 
absolute area \A\ of the post-before-pre lobe increases, 
the stable region in the relative time constants r\ and 
r2 tends to shrink. Hence the post-before-pre lobe can 
be thought of as destabilizing in such cases. In cases ee 
and ae the situation is less clear. Increasingly negative 
A (larger depressive post-before-pre) is uniformly desta- 
bilizing, but increasingly positive A (larger potentiating 



12 




FIG. 9: Boundary curves of the stable region in (ri,r2) for various values of A, for two-lobe C with ai = —1. Curves are 
labelled by A. Curves with A > are drawn with solid lines, curves with A < with dashed lines. In all cases the region of 
stability is on the side of the curve containing the diamond (o) in the upper left corner of the plot. The interval of stability for 
the corresponding one-lobe learning rules is the portion of the ri-axis in bold. 



post-before-pre) appears to be destabilizing for small r2 
but stabilizing for large r2- 

Cooperative stability, in which a two-lobe rule is stable 
while each of its lobes individually would be unstable, 
occurs in cases ea, ae, and aa: any point (ri,r2) in a 
stable region, with ri outside the interval in which the 
corresponding one-lobe rule is stable is an example of 
cooperative stability. 

Finally, the shape and extent of stable regions for two- 
lobe learning rules, or the extent of stable intervals for 
one-lobe learning rules, depend critically on whether £ 



and C are exponential or alpha function in form. This 
suggests that in order to infer even such qualitative prop- 
erties as stability or instability in a biological context, the 
learning rule must be known with considerable precision. 

However, for particular values of some parameters the 
dependence on functional form may be such that useful 
conclusions can still be drawn in the absence of such pre- 
cision; for example, the stability in one-lobe, depressive 
pre-before-post learning rules with tl/te — 1, indepen- 
dent of whether £ or C arc exponential or alpha function 
in form. This particular finding has direct relevance to 



13 



the learning rule observed experimentally in mormyrid 
ELL j7(| . The experimental data is not precise enough to 
suggest a particular functional form, but does indicate a 
one-lobe, depressive, pre-before-post rule, with a width 
of the same order of magnitude as the width of a PSP. 
Stability of such a rule is consistent with the analytic 
results derived above. 



VIII. APPENDIX 

For completeness we provide below the polynomial 
conditions for stability of the two-lobe learning rules 
treated in the examples. 

ee: ak'^ + bP + c < for aU k 
a = (Tirirl — Arjr2 
b = cri(r| + ri) + A{rl - rj) 
c = 0-1 + A 

ea: ak^ + bk^ + ck'^ + d < for all k 
a = a-irir|(2r2 - 1) - Arlr2{2ri + 1) 
b — (Tir2{r2 — 'irfr2 + 6rir2 + ri) + Ari{rf — 3rirl — 
6rir2 + r2) 

c = ai {2rl - + 2ri) + A(2rf - r| - 2r2) 
d = ai+ A 



ae: afc* -I- bk"^ -t- c < for all k 

a = CTir|(2ri - 1) - Arl{2r2 + 1) 

b = (Ji{rl + 2ri - 1) + A{rl - 2r2 - 1) 

c = (Ji+ A 

aa: afc* + 6fc^ + ck^ + dk"^ + e < {) for aU k 
a = (Tirfr2 + Arfr^ 

b = o-i(— r| — 2r^r| + 4rir| — rir^ + Srlr"^ + 2rir|) 
+ Ari{-rf + 2rlrl - 4:rfr2 - rfr2 = 2r^r2 -f 3r^r^) 
c = cri(-3rir2 + (rf + r|)(r2 + 1)^ + r|(l + 4ri - 
4rir2)) 

-hA(-3rir2 + (r? + r|)(ri-l)2 + rf(l-4r2-4rir2)) 
d = cri(2r| - + 4ri - 1) + A(2r^ - r-| - 4r2 - 1) 
e = ai+A 
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